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ABSTRACT 



The coding mode determining section, when receiving the 
information as to occurrence of a scene change from the 
scene change detector, outputs a piece of mode control 
information to the coding controller. The coding controller, 
based on the amount of coding in the coder and the mode 
control information, controls the quantizer by setting up a 
quantization stepsize so that the current frame will have the 
target amount of coding. In this way, the quantization and 
coding are controlled by three stages, i.e., immediately after 
a scene change, from the scene change to the stabilization of 
the amount of coding, and after the stabilization of the 
amount of coding, to thereby prevent degradation of picture 
quality. 

5 Claims, 8 Drawing Sheets 
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MOVING PICTURE CODING APPARATUS 
BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention relates to a moving picture coding s 
apparatus which performs an orthogonal transform of an 
input picture by dividing it into two-dimensional blocks and 
quantizes and codes the data, and more particularly relates 
to a moving picture coding apparatus which quantizes and 
codes data of picture by extracting a specific area from the 
frame of picture in a manner so as to enhance the picture 10 
quality of the extracted area. 

(2) Description of the Related Art 

Recently, visual communications services such as video 
telephone, video conference etc., show great prospect as an 
efficient way of using ISDN (Integrated Services Digital 15 
Network) and GSTN (General Switched Telephone 
Network) services. Therefore, investigations into high effi- 
ciency coding techniques aiming at efficient transmission of 
such moving pictures have been intensively carried out. 
Investigations of these techniques were based on statistic 20 
properties of pictures to remove redundancy contained in the 
pictures to thereby reduce the amount of information. As the 
coding techniques, the hybrid coding technique is well 
known which is a combination of motion-compensated 
prediction and the discrete cosine transform. 2 5 

However, in the case of transmission at a low bit rate, the 
quality of the regenerated picture is degraded due to noise 
generation. Hence, improvement against this has been 
desired. As a method for improvement of picture quality, a 
technique has been investigated in which specific areas are 30 
extracted from the input picture so that the quantization 
stepsize is controlled separately for each area. As an 
example of this, there is an idea for improving the picture 
quality subjectively, by extracting the face area from the 
input picture so that areas excepting the face area hereinafter 35 
referred to as 'background' will be quantized based on a 
quantization stepsize greater than that for the face area, to 
thereby reduce the amount of coding allotted for these areas 
while a greater amount of coding will be allotted for the face 
area (for example, R. H. J. M. Plompen, et al.: "An image 40 
knowledge based video codec for low bitrates", SPIE Vol. 
804 Advanced in image processing (1987)). 

Referring now to FIG. 1, a conventional example using 
motion compensated prediction and a two-dimensional 
orthogonal transform will be explained. In FIG. 1, the 45 
conventional system includes: a frame memory section 81; 
a subtracter 82; an orthogonal transformer 83; a quantizer 
84; a coding section 85; a buffer memory section 86; an 
inverse quantizer 87; an inverse orthogonal transformer 88; 
an adder 89; a frame memory section 90; a motion detecting 50 
section 91; a motion compensation predicting section 92; an 
area extracting section 93; and a coding control section 94. 

Now, suppose a picture is input to frame memory section 
81. The input picture is a digitized picture obtained from a 
video camera or the like, and is stored in frame memory 55 
section 81 and is divided into blocks of NxM pixels (N and 
M are natural numbers). The picture stored in frame memory 
section 90 and the picture stored in frame memory section 81 
are input to motion detecting section 91 where the motion 
vectors are detected. In motion compensation predicting 60 
section 92, motion compensated prediction values are deter- 
mined based on the motion vectors and the picture stored in 
frame memory section 90. The power of the differences 
between the motion compensated prediction values and the 
input picture and the power of the input picture are com- 65 
pared to choose interframe prediction or intraframe predic- 
tion. 
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In subtracter 82, the difference between the input picture 
in frame memory section 81 and motion compensated pre- 
diction value from motion compensated predicting section 
92 is calculated for each block unit. Orthogonal transformer 
83 implements the two-dimensional orthogonal transform of 
the pixels in each block and outputs the transform coeffi- 
cients to quantizer 84. Quantizer 84 quantizes the transform 
coefficients based on the quantization stepsize output from 
coding control section 94. Coding section 85 implements 
entropy coding of the quantized output from quantizer 84 to 
generate coded information. Buffer memory section 86 
accumulates the coded information in order to make the 
system capacity match the transmission rate of the network. 

The output from quantizer 84 is also input to inverse 
quantizer 87, where it is inverse quantized to produce 
transform coefficients. In inverse orthogonal transformer 88, 
the transform coefficients are subjected to the two- 
dimensional inverse orthogonal transform, and the result and 
the motion compensated prediction value from motion com- 
pensation predicting section 92 are added in adder 89. The 
thus added picture is stored in frames memory section 90 to 
be used in the next process. Coding controlling section 94 
receives valid/invalid information about the face area and 
the background area as the output from area extracting 
section 93 and the occupied amount of buffer memory 
section 86, and determines the quantization stepsize based 
on these pieces of information. For example, the valid 
information indicating the face area and the invalid infor- 
mation indicating the background area are output from area 
extracting section 93 to coding controlling section 94, which 
chooses a quantization stepsize for the face area smaller than 
that for the background area, based on the quantization 
stepsize determined from the occupied amount of buffer 
memory section 86. 

The above technique only sets two levels of quantization 
stepsize for the face area and the background area, and only 
specifies the fact that the quantization stepsize for the face 
area is smaller than that for the background area. Therefore, 
for actual application of this configuration to a real moving 
picture coding apparatus, the following operation may and 
should be done, for instance. Coding controlling section 94 
defines dQf, dQb, which are the amounts of displacement for 
the extracted result from the area extracting section for the 
quantization stepsize Q which is determined based on the 
occupied amount of the coded information in buffer memory 
section 86. Quantizer 84 quantizes the data for the face area 
using Q-dQf and the data for the background using Q+dQb. 

However, in this method, noise etc. existing in the back- 
ground will also be quantized even though the quantization 
stepsize is set large, an increased amount of coding arises, 
which means a reduction in the amount of coding which can 
be allotted to the face area. Further, since a picture greatly 
differs from the previous frame when a scene change occurs, 
if the amount of coding for the background is low, the 
picture quality of the background area will not become 
stabilized at an early stage and the reproduced picture 
becomes rough and ugly, tending to cause block distortion 
and mosquito noise around the face area due to sharp 
increase in amount of coding. 

Since only the occupied amount of the coded information 
in buffer memory 86 is referred to when coding controlling 
section 94 performs control, the quantization stepsize is 
determined for that buffer's occupied amount, which makes 
it difficult to attain the desired, proper, amount of coding. 
Consequently, variations in picture quality become large 
between frames, lowering the picture quality. 

Moreover, though frames after a scene change, in general, 
have strong correlation, it is difficult to control quantization 
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so as to attain the target, proper, amount of coding since this 
system does not use the information from the quantization 
stepsize of the previous frame or the information as to the 
amount of coding. 

When the amount of displacement of Q (dQf) is kept fixed 5 
independent of the size of the face area, the amount of 
coding per frame may become too high or too low with 
respect to the target amount of coding depending upon the 
size of the face area, resultantly the picture quality of the 
reproduced picture is degraded. 1° 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide 
a moving picture coding apparatus which can improve the 15 
picture quality by adap lively controlling the quantization 
and coding in multiple stages after a scene change when a 
scene change is detected. 

In order to achieve the above object, the present invention 
is configured as follows: 20 

In accordance with the first aspect of the invention, a 
moving picture coding apparatus includes: 

a motion detecting means for detecting motion vectors by 
dividing the input picture into blocks of NxM pixels (N 
and M are natural numbers) and determining the inter- 25 
frame difference for each block between the current 
frame and the previous frame; 
a motion compensation predicting means for determining 
motion compensated prediction values from the motion ^ Q 
vectors to select interframe prediction or interframe 
prediction; 

an orthogonal transforming means for obtaining trans- 
form coefficients by performing an orthogonal trans- 
form of the difference between the input picture and the 35 
motion compensated prediction values; 

a quantizing means for quantizing the transform, coeffi- 
cients; 

a coding means for coding the quantized transform coef- 
ficients to generate coded information; 40 

a block skip determining means for determining blocks to 
skipped without coding, based on the interframe 
difference, determined by the motion detecting means, 
between the current frame and the previous frame and 
based on the determined result of the motion compen- 45 
sated prediction obtained from the motion compensa- 
tion predicting means; 

a specific area extracting means for extracting specific 
area from the input picture; sq 

a scene change detecting means for detecting a scene 
change based on the interframe difference; 

a coding mode determining means which, when the scene 
change detecting means has detected a scene change, 
determines which mode the current state is in among 55 
three modes, the scene change frame mode for coding 
the scene change frame, the post-scene change mode 
for coding a predetermined number of frames after the 
occurrence of the scene change, and the specific area 
mode in which frames downstream are coded to fi0 
improve the quality of picture of the specific area which 
has been extracted by the specific area extracting 
means; and 

a coding control means which, based on the mode deter- 
mined by the coding mode determining means, controls 65 
the quantization in a manner such that a scene change 
frame and a predetermined number of frames down- 



stream are quantized by setting up a quantization 
stepsize at the quantizing means and by using the 
quantization stepsize which allows no discrimination 
between the specific area and the area other than the 
specific area whilst thinning frames; and frames after 
the predetermined number of frames are quantized 
setting up a quantization stepsize at the quantizing 
means for increasing the coding amount of the specific 
area whilst restoring the original frame rate, and is 
characterized in that the coded information is transmit- 
ted at a predetermined frame rate by making the system 
capacity match the transmission rate of the network. 
In accordance with the second aspect of the invention, the 
moving picture coding apparatus having the above first 
feature is characterized in that the coding control means 
comprises: 

an intraframe coding control means which, in the scene 
change frame mode, increases the amount of coding per 
frame by reducing the frame rate and sets up a quan- 
tization stepsize based on which the scene change 
frame is coded by intraframe coding without making 
any distinction as to the specific area; 

a scene change coding control means which, in the 
post- scene change mode, increases the amount of cod- 
ing per frame by reducing the frame rate and sets up a 
quantization stepsize based on which a predetermined 
number of frames after a scene change are coded using 
the information of the previous frame without making 
any distinction as to the specific area; 

a specific area enhancement coding control means, which 
in the specific area mode, sets up a quantization step- 
size in accordance with the coding amount information 
from the coding means, to perform coding based on the 
information as to skip blocks obtained from the block 
skip determining means and based on the information 
as to the specific area extracted by the specific area 
extracting means; and 

a switching means for selecting one of the three control 
signals based on the mode information from the coding 
mode determining means. 

In accordance with the third aspect of the invention, the 
moving picture coding apparatus having the above second 
feature is characterized in that the intraframe coding control 
means comprises: 

a target intraframe-coding amount computing means for 
calculating the target coding amount of a scene change 
frame with the frame rate reduced; 

a quantization stepsize setting means, which sets up a 
quantization stepsize based on the target coding 
amount, using the previously prepared relationship 
between target coding amounts and quantization step- 
sizes; 

a coding limit monitoring means which, based on the 
maximum coding amount per frame defined by the 
standard, monitors whether the amount of coding in the 
coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 

a quantization stepsize increment means for increasing the 
quantization stepsize when the amount of coding in the 
coding means exceeds the coding limit; 

a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize setting means and the quantization stepsize 
which has been increased by the quantization stepsize 
increment means; and 
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an average quantization stepsize computing means for 
calculating the average value of the quantization step- 
sizes thus added, wherein all the above means are 
activated when the scene change frame mode informa- 
tion is input from the coding mode determining means, s 
In accordance with the fourth aspect of the invention, the 
moving picture coding apparatus having the above second 
feature is characterized in that the scene change coding 
control means comprises: 

a target scene-change -coding amount computing means 10 
for calculating the target amount of coding per frame by 
reducing the frame rate; 

a coding limit monitoring means which, based on the 
maximum coding amount per frame defined by the 
standard, monitors whether the amount of coding in the 15 
coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 

a coding interrupting means for interrupting the coding of 2Q 
the current frame when the present amount of coding 
exceeds the coding limit; 

a quantization stepsize variational range checking means, 
which checks whether the input quantization stepsize 
falls within the specified range, and replaces the quan- 2 5 
tization stepsize with a closest value thereto falling 
within the specified range when the quantization step- 
size falls out of the specified range, while uses the 
original quantization stepsize when the quantization 
stepsize falls within the specified range; 30 

a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize variational range checking means; 

an average quantization stepsize computing means for 
calculating the average value of the quantization step- 35 
sizes thus added; 

an initial quantization stepsize computing means which 
computes the initial quantization stepsize based on the 
average quantization stepsize in the scene change frame 
and outputs the result to the quantization stepsize 40 
variational range checking means; and 
a quantization stepsize computing means which computes 
the quantization stepsize based on the target amount of 
coding, the information of the amount of coding not 45 
exceeding the coding limit and the average quantization 
stepsize for the previous frame and outputs the result to 
the quantization stepsize variational range checking 
means, wherein all the above means are activated when 
the post scene change mode information is input from 5Q 
the coding mode determining means. 
In accordance with the fifth aspect of the invention, the 
moving picture coding apparatus having the above second 
feature is characterized in that the specific area enhancement 
coding control means comprises: 55 

a target specific-area-enhancement coding amount com- 
puting means for calculating the target amount of 
coding per frame; 

a target coding amount computing means for specific area 
allocation which, based on the information as to skip 60 
blocks from the block skip determining means, the 
information as to the specific area extracted by the 
specific area extracting means and the information as to 
the target amount of coding from the target specific- 
area-enhancement coding amount computing means, 65 
computes the amount of coding to be allotted for the 
specific area and that for other than the specific area; 
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a coding limit monitoring means which, based on the 
maximum coding amount per frame defined by the 
standard, monitors whether the amount of coding in the 
coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 
a coding interrupting means for interrupting the coding of 
the current frame when the present amount of coding 
exceeds the coding limit; 
a quantization stepsize variational range checking means, 
which checks whether the input quantization stepsize 
falls within the specified range, and replaces the quan- 
tization stepsize with a closest value thereto falling 
within the specified range when the quantization step- 
size falls out of the specified range, while uses the 
original quantization stepsize when the quantization 
stepsize falls within the specified range; 
a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize variational range checking means; 
an average quantization stepsize computing means for 
calculating the average value of the quantization step- 
sizes thus added; 
an initial quantization stepsize computing means which 
computes the initial quantization stepsize based on the 
average quantization stepsize in the post-scene change 
mode and outputs the result to the quantization stepsize 
variational range checking means; and 
a quantization stepsize computing means which computes 
the quantization stepsize based on the target amount of 
coding, the information of the amount of coding not 
exceeding the coding limit, the information as to skip 
blocks from the block skip determining means, the 
specific area information from the specific area extract- 
ing means and the average quantization stepsize for the 
previous frame and outputs the result to the quantiza- 
tion stepsize variational range checking means, 
wherein all the above means are activated when the specific 
area mode information is input from the coding mode 
determining means. 

In the present invention, the transform coefficients 
obtained by performing a two-dimensional orthogonal trans- 
form of the difference between the input picture and the 
motion compensated prediction value in each block are 
quantized and coded to generated coded information, which 
is output at a transmission rate matching the network. 
However, when a scene change frame occurs, the picture 
content of the frame is greatly different from that of the 
previous frame, so that the information from the previous 
frame cannot be used, which leads to sharp increase in the 
amount of coding, resulting in degradation of the picture 
quality. To deal with such a situation, the coding mode 
determining means discriminates the state after a scene 
change into three modes, i.e., the scene change frame mode, 
the post-scene change mode and the specific area mode. The 
coding control means controls quantization based on the 
mode thus determined. Illustratively, in the scene change 
frame mode and the post-scene change mode, the amount of 
coding per frame is increased by reducing the frame rate for 
the scene change frame and a predetermined number of 
frames downstream and quantized with a quantization step- 
size without making any distinction as to the specific area to 
thereby improve the picture quality. Then, a large amount of 
coding is allotted to the specific area when the picture 
quality has become stabilized in the special area mode, to 
thereby improve the picture quality. 
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BRIEF DESCRIPTION OF THE DRAWINGS determined by coding controlling section 17 in order to 

, . , achieve a high efficiency of coding, to thereby reduce the 

FIG. 1 is a block diagram showmg an example of a DCp coefficients to be coded. The thus quantized DCT 

conventional moving picture coding apparatus; coefficients are supplied to coding section 5. In coding 

FIG. 2 is a block diagram showing one embodiment of a s section 5, the DCT coefficients thus quantized are subjected 

moving picture coding apparatus in accordance with the to entropy coding so as to allot them with appropriate codes 

invention, l0 produce coded information of variable length codes, 

FIG. 3 is a block diagram showing the configuration of a which is then output, 

specific area extracting section; Buffer mcm0 ry section 6 stores the coded information 

FIG. 4 is an illustrative diagram showing a specific area 10 generated from coding section 5 in order to make the system 

block map; capacity match the transmission rate of the network and to 

FIG. 5 is a block diagram showing the configuration of a output the coded information at a fixed rate. Inverse quan- 

coding control section; tizer 7 performs inverse quantization which is a process 

FIG. 6 is a block diagram showing the configuration of an 1C opposite to that performed in quantizer 4, to output inverse 

intraframe coding control section; 15 q uantized DCT coefficients to inverse orthogonal trans- 

- • Li . j- , _ . . former 8. Inverse orthogonal transformer 8 performs a 

FIG 7 is a block diagram showing the configuration of a tW0 . dimensioDal inveree discrete cosine transform . m en 

scene change coding control section; and a(Jder 9 ^ up fte jmage from iayax orthogona , trans . 

FIG. 8 is a block diagram showing the configuration of a former 8 and the motion compensated prediction values 

specific area enhancement coding control section. 20 f rom motion compensation predicting section 12, and the 

DESCRIPTION OF THE PREFERRED ' S S '° re f in ffame mem °«? S ? Cti ° n ^ „.„ 

EMBODIMENTS motion detecting section 11, the interframe difference 

between the image in frame memory section 10 and the 

One embodiment of the invention will hereinafter be picture in frame memory section 1 is determined for each 

described with reference to the accompanying drawings. 25 macroblock as a unit, and motion vectors are detected based 

FIG. 2 is a block diagram showing one embodiment of a on the determined result and are output to motion compen- 
moving picture coding apparatus in accordance with the sation predicting section 12. The interframe difference for 
invention. This moving picture coding apparatus controls each macroblock is also supplied to block skip determining 

quantization and coding so as not to degrade the picture 3Q section 13 and scene change detecting section 15. 
quality, taking into account the sharp increase in the amount Motion compensation predicting section 12 determines 
of coding of the picture at a scene change, at which the motion compensated prediction values based on the picture 
current frame totally changes from the previous frame. That in frame memory 10 and motion vectors from motion vector 
is, the operation is performed such that quantization and detecting section 11. Further, the power of the difference 

coding are controlled based on three stages, i.e., that imme- 35 between the motion compensated prediction values and the 
diately after the scene change, that from the scene change to input picture and the power of the input picture are corn- 
stabilization of the picture quality, and that after the stabi- pared to choose interframe prediction or intraframe predic- 
lization of the picture quality. tion. This determined result is input to block skip determin- 

First, as shown in FIG. 2, this moving picture coding mg^ectionJL3. _____ 

apparatus includes: a frame memory section 1, a subtracter 4Q ^In block skip determining section" 13, a map for improving^ 
2; an orthogonal transformer 3; a quantizer 4; a coding the coding efficiency is prep ared-in„ a manner so that-mac^ 
section 5; a buffer memory section 6; an inverse quantizer 7; roblocks having little difference from that of the previous f 
an inverse orthogonal transformer 8; an adder 9; a frame frame are skipped and will not be coded. This is done as f 
memory section 10; a motion detecting section 11; a motion follows: when the x-component and y-component of the j 

compensation predicting section 12; a block skip determin- 45 motion vector of a macroblock from motion detecting sec- ; 
ing section 13; a specific area extracting section 14; a scene tion 11 are both zero, the interframe difference is smaller ■ 
change detecting section 15; a coding mode determining than a predetermined value and if the determined result from \ 
section 16; and a coding controlling section 17. The differ- motion compensation predicting section 12 is not that of ! - 
ence from the conventional moving picture coding apparatus intraframe-prediction, the block is skipped so as not to be ^ 

is that this configuration has block skip determining section jj^coded. — — — ~ Z-^-' 1 '^ 

13, scene change detecting section 15 and coding mode 'Specific area extractingsection 14*extractsspecific areas 
determining section 16. to be improved in picture quality. When, for example, the 

The operation of the above moving picture coding appa- moving picture coding apparatus is applied to a video phone 
ratus is as follows: or video conference, the most significant area is the face area 

Frame memory section 1 stores the input picture of a 55 in general. Therefore, extracting the face area and enhance- 
common format (CIF or QCIF) conforming to ITU-TH.261 ment of that area in picture quality provide improvement of 
standard, for example. Here, description will be made refer- subjective picture quality. For this reason, here, the face area 
ring to an example of a QCIF input picture. In subtracter 2, is assumed to be the specific area, and the technique to 
the difference between the input picture stored in frame extract the face area will be described. In this case, the area 

memory section 1 and the motion compensated prediction 60 excepting the face area is assumed to be the background 
value computed by motion compensation predicting section area. 

12 is subjected to, for example, a two-dimensional discrete FIG. 3 is a block diagram showing the configuration of 
cosine transform (DCT) for each block of 8x8 pixels, and specific area extracting section 14. This specific area extract - 
the data signal is converted from the time domain to the ing section 14 includes a picture contracting section 21, a 

frequency domain and the DCT coefficients are output to 65 colorimetric system converter 22, a specific color area 
quantizer 4. Quantizer 4 performs quantization of the DCT extracting section 23, a pixel number counter 24 and a 
coefficients based on the quantization stepsize which was specific area block determining section 25. 
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The thus configured specific area extracting section 14 
operates as follows: 

Picture contracting section 21 receives, Y, Cb and Cr 
components of the input picture stored in frame memory 
section 1 to create a contracted image having the predeter- 
mined size. Preparation of the contracted image makes it 
possible to shorten the subsequent processitime an ng d keep 
significant information while leaving out small variations as 
to luminance and color difference. Here, the Y-components 
of the input picture are averaged every 4x4 pixels and the 
data is reduced to Vis. The Cb-components and 
Cr-components of the input picture are averaged every 2x2 
pixels and the data is reduced to Ya, Here, in the reduced 
picture, the size corresponding to the macroblock of the 
input picture is called unit block. 

Colorimetric system converter 22 converts the contracted 
image from the YCbCr colorimetric system into the HSV 
colorimetric system. The HSV system is known as a per- 
ceptual calorimetric system which models more closely 
parallel human perception of colors. Since this system has 
less correlation between the components compared to the 
YCbCr colorimetric system which has high correlation 
between the components, this system is suitable for area 
division based on color. 

The conversion formulas between the calorimetric sys- 
tems are as follows. Conversion is performed by converting 
Y, Cb and Cr components into the RGB calorimetric system 
first, using formulae (1) to (3), then converting them into the 
HSV calorimetric system using formulae (4) to (6). 



R-Y+1.4020Cr 



G-Y-0.3441Cb-0.7139Cr 



B-Y+1.7718Cb-0.012Cr 



H=cos -1 [{(R-G)+(R-B)}/2^(R-G) z 4(R-B)(G-B)] 
S-{max(R,G ) B)-mm(R,G > B)}/V 

V-max(R,G,B) 



(1) 
(2) 
(3) 

<*) 

(5) 
(6) 



Th WZf <H/y<Th /ft/ 



where H„ is the pixel value of the H component image and 
T\x HL and Th HU are the thresholds for extracting the face 
area. 

Pixel number counter 24 counts the number of pixels, 
belonging to the face area determined by specific color area 
extraction section 23, in each unit block, and outputs the 
count result for each unit block to specific area block 
determining section 25. Specific area block determining 
section 25 compares the count result for each unit block 
from pixel number counting section 24 with the threshold 
for determining significant blocks and determines whether 
the count result is equal to or greater than the threshold. 
During this process, section 25 classifies a block equal to the 
threshold or greater as a significant block and a block less 
than the threshold as an insignificant block to produce a 
block map of one frame of the input picture and then outputs 
this map. 



In specific color area extracting section 23, to enable 
stable extraction of the face area, the face area is extracted 
based on the contracted image of the H component which, 
in the HSV colorimetric system, has the characteristic of 
being not readily affected by shading and/or shadows. The 
extraction is performed so that the following conditions are 
satisfied: 



CO 



Here, the threshold for significant block determination is 
set up with reference to the target amount of coding for one 
frame. When the target amount of coding is small, the 
threshold is set high in order to extract more valid unit 

5 blocks, so that unit blocks having a lower count at pixel 
number counting section 24 are removed When the target 
amount of coding is large, the threshold is set low in order 
to perform exact transmission of fine image detail, so that 
unit blocks having lower count at pixel number counting 

10 section 24 can be extracted. In this way, the threshold for 
specific area block determination is previously set so that it 
will become smaller stepwise as the target amount of coding 
increases. 

FIG. 4 shows the result of the specific area block deter- 
15 mination with a certain threshold. Here, the hatched, specific 
area blocks are extracted and the map of one image frame of 
specific area blocks is termed a specific area block map. 
Since this embodiment is configured for QCIF, one block of 
the specific area block map corresponds; to one macroblock 
20 and is configured of 99 blocks. 

Scene change detecting section 15 informs coding mode 
determining section 16 of the occurrence of a scene change 
when the following relation (8) is satisfied: 

M SAD^Thyc (8), 

where SAD JMm is the sum of the interframe differences for 
individual macroblocks from motion detecting section 11 
and Th sc is the threshold for scene change detection. 
Coding mode determining section 16, when receiving the 

30 information as to the occurrence of a scene change from 
scene change detecting section 15, outputs a piece of mode 
information to coding control section 17. This mode control 
information is of three types of control information: the first 
for the scene change frame mode in which intraframe coding 

35 control is performed for the scene change frame; the second 
for the post -scene change mode in which scene change 
coding control is performed for a predetermined number of 
frames after the scene change in order to stabilize the quality 
of picture at an early stage; and the third for the specific area 

40 mode in which specific area enhancement coding control is 
performed in order to improve the picture quality of a 
specific area for frames downstream. Coding control section 
17 controls quantizer 4, based on the mode control 
information, so that the current frame will have the prede- 

45 termined amount of coding. 

FIG. 5 is a block diagram showing the configuration of 
coding control section 17. This coding control section 17 
comprises: an intraframe coding control section 41; a scene 
change coding control section 42, a specific area enhance- 

50 ment coding control section 43 and a switching section 44. 
Coding control section 17 having the above configuration 
operates as follows: 

When coding control section 17 receives the control 
information for the scene change frame mode from coding 

55 mode determining section 16, and hence is instructed to 
effect intraframe coding control, intraframe coding control 
section 41 performs intraframe coding control on the current 
frame (the scene change frame) based on the information as 
to the amount of coding from coding section 5 (FIG. 2), and 

60 determines the quantization stepsize. Intraframe coding con- 
trol section 41 outputs the average quantization stepsize to 
be used for coding control of the next frame to scene change 
coding control section 42. Switching section 44 performs 
switching so that the quantization stepsize, which was 

65 determined by intraframe coding control section 41 in 
accordance with the mode control information, is output to 
quantizer 4 (FIG. 2). 
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When the intraframe coding of one frame (the scene than the target frame rate. Since the transmission rate is a 

change frame) has been completed, coding control section fixed value, the target coding amount per frame is increased 

17 receives the control information for the post-scene by frame thinning, thus making it possible to mitigate block 

change frame mode, hence scene change coding control distortion and/or mosquito noise even when intraframe 

section 42 performs scene change coding control on the 5 coding, which needs a large amount of coding, is performed, 

current frame based on the information as to the coding In quantization stepsize table section 53, in accordance 

amount from coding section 5 (FIG. 2), and determines the with InitB mry<rr one appropriate quantization stepsize QP intra 

quantization stepsize. During scene change coding control, is selected from the table in which quantization stepsizes are 

the picture quality is enhanced by thinning frames whilst not previously defined in relation to coding amounts, and the 

making any distinction between the specific area and other 10 selected quantization stepsize is output to be used for the 

than the specific area. Scene change coding control section quantization of eleven macroblocks. The reason for using 

42 outputs the average quantization stepsize to be used for quantization stepsize table section 53 is that the scene 

coding control of the next frame to specific area enhance- change frame cannot refer to the quantization stepsize of the 

ment coding controlling section 43. Switching section 44 previous frame, so it is necessary to previously set up the 

performs switching so that the quantization stepsize, which 15 relationship between InitB Mfyrt and quantization stepsize. 

was determined by scene change coding control section 42 This quantization stepsize is also input to quantization 

in accordance with the mode control information, is output stepsize adding section 54 where the used quantization 

to quantizer 4 (FIG. 2). stepsizes are added up in order to determine the average 

When scene change coding for the pre determined number quantization stepsize in one frame, 

of frames has been finished, coding control section 17 20 After the completion of quantization of the first eleven 

receives the control information for the specific area mode, macroblocks, operation control section 51 gives instructions 

hence specific area enhancement coding control section 43 to determine the quantization stepsize for the next eleven 

performs specific area enhancement coding control on the macroblocks and downstream. First, the coding amount 

current frame based on the information as to the coding information B? mb representing the present coding amount of 

amount from coding section 5 (FIG. 2), the block skip map 25 the current frame is input from coding section 5 to coding 

from block skip determining section 13 (FIG. 2) and the limit monitoring section 56, where it is checked by the 

specific area block map from specific area extracting Section following relation whether the input exceeds the present 

14 (FIG. 2), and determines the quantization stepsize. coding limit B max , mh . Here, coding limit B ma ^ mb is deter- 

Switching section 44 performs switching so that the quan- mined every eleven macroblocks, in order to avoid the 

tization stepsize, which was determined by specific area 30 coding amount for one frame exceeding the maximum 

enhancement coding control section 43 in accordance with coding amount per frame, conforming to the H.261 standard, 

the mode control information, is output to quantizer 4 (FIG. That is, the maximum coding amount of the standard is 

2). divided for eleven macroblocks and then the quotient is 

FIG. 6 is a block diagram showing the configuration of the accumulated to determine the coding limit B m ^ mi . 

aforementioned intraframe coding control section 41. This 35 

intraframe coding control section 41 comprises an operation B r«i. >B «ax-mf. ( 10 ) 

control section 51, a target intraframe-codine amount com- „„ , A . . . 

mry *■ *■ * ■ * uT r When the relation (10) is satisfied, it means that the 

pu ting section 52, a quantization stepsize table section 53; a * j. t . ^ 

<• < • Ji- *■ ca *• current coding amount surpasses the coding limit. Therefore, 

quantization stepsize adding section 54, an average quanti- r i ■ , 

t • t - j- i- •* • the quantization stepsize used tor the previous eleven mac- 

zation stepsize computing section 55, a coding limit mom- 40./*.. v. c „ F 

4 ■ ec a *• #• * • ■ * roblocks is increased as follows: 
tonng section 56 and a quantization stepsize increment 

section 57. QP^-QP^+i (li). 

Intraframe coding control section 41 having the above 

configuration operates as follows: Here, from equation (11), the quantization stepsize is 

Operation control section 51, based on the input mode 45 increased by only one, but the increment may be greater than 

control information (of the scene change frame mode), one. In this way, when the current coding amount surpasses 

controls the determining operation of the quantization step- the coding limit, the coding amount for the next eleven 

size for the macroblocks in one frame (the scene change macroblocks can be reduced by increasing the quantization 

frame). In this embodiment, in view of reducing the pro- stepsize, thus absolutely avoiding the coding amount of one 

cessing amount, one quantization stepsize is determined 50 frame exceeding the maximum coding amount of the stan- 

every eleven macroblocks (the number of the macroblocks dard. 

in one row in FIG. 4), but the present method can be applied This quantization stepsize is output to switching section 

to determination of quantization stepsize for an arbitrary 44 to perform quantization of the next eleven macroblocks 

number of macroblocks. Specifically, quantization stepsize and also supplied to quantization stepsize adding section 54 

may be determined at intervals of an arbitrary period, every 55 in the same manner as above. This process, i.e., the process 

macroblock or every 33 macroblocks, for example. for eleven macroblocks as a unit, is repeated throughout all 

First, in order to compute the target coding amount per the macroblocks in the current frame. Then, when the last 

frame for the current frame, operation control section 51 eleven macroblocks have been quantized, the average value 

activates target intraframe-coding amount computing sec- of the quantization stepsizes used in the current frame is 

tion 52, at the beginning of each frame. Here, the target 60 calculated by average quantization stepsize computing sec- 

intraframe coding amount, lni\B rarget is computed by fol- lion 55 and is output to scene change coding control section 

lowing equation (9). 42 (FIG. 5). 

rnitR R//f if \ fa\ FIG - 7 k a bl 00 ^ diagram showing the configuration of 

iiuuW^WW W. scene chauge control gecUon 42 Scene change 

where R is the image transmission rate, f target is the target 65 coding control section 42 comprises an operation control 

frame rate and f /actor is a value greater than 1. By the division section 61, a target scene-change coding amount computing 

°f £targ*t by factor* tDe resultant frame rate becomes smaller section 62, an initial quantization stepsize computing section 
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63, a quantization stepsize variational range checking sec- tion stepsize adding section 65, where the used quantization 

tion 64, a quantization stepsize adding section 65, a coding stepsizes are added up in order to determine the average 

limit monitoring section 66, a coding interrupting section 67, quantization stepsize in one frame. 

a quantization stepsize computing section 68 and an average Aft er tne completion of quantization of every eleven 

quantization stepsize computing section 69. 5 macroblocks, operation control section 61 activates coding 

Scene change coding control section 42 thus configured limit monitoring section 66. Coding limit monitoring section 

operates as follows: 66 receives the coding amount information representing the 

Operation control section 61, based on the input mode P resent codin S amount of ^ CLjrrent frame from codin S 

control information (of the post-scene change mode), con- secl l on f ( F J G ' 2 > and a °q u * es *e amount of coded infor- 

trols the determining operation of the quantization stepsize 10 ma ^ on ( codin f amount B ^>^ }° ( thc ? rre * macroblock 

for the subsequent macroblocks. In this embodiment, from ! n * e *«™ «> « ^ check, based on the aforemen- 

tU • * i c j . . tioned relation (10), whether the input exceeds the present 

me same viewpoint as aoove or reducing tne processing codi Umit B Wherl the re i ation ( 1Q \ 

is satisfied, it 

amount, one quantization stepsize is determined every means mat tne "~ r 7 e fc nt codi amount the co6 ( 

eleven macroblocks but the present method can be applied ^mit. Therefore, the coding amount cannot be increased 

to determination of quantization stepsize for an arbitrary 15 above its present amount. At this moment, coding interrupt- 

number of macroblocks. Specifically, quantization stepsize ing section 67 stQps the quantization of the remainmg 

may be determined at intervals of an arbitrary period, every macro blocks in the current frame while average quantization 

macroblock or every 33 macroblocks, for example. stepsize computing 69 imputes the present average 

First in order to compute the target coding amount per quant i za tion stepsize and outputs it. Since macroblocks 

frame for the current frame, operation control section 61 20 downslream wiU not be coded> the picture of the previous 

activates target scene-change coding amount computing frame will be used 

section 62, at the beginning of each frame. Here, the target Quantization stepsize computing section 68 is activated 

scene-change coding amount, ScB, a ^, is computed by when coding Hmit monitoring secuon 66 has determined that 

following equation (12). the caneaX amount ^ not greater than me coding 

ScB R/lf jt ) (12) 25 ^ m * 1, ™ s section operates so that when the current coding 

c ,. rg <r ta , g J f* C H,r} ( ), amoimt gre ater than the target coding amount ScB mr ^ cr 

where R is the image transmission rate, f is the target takin S into account the current position of coding, the 

frame rate and t actar is a value greater than 1. By the division quantization stepsize for the next eleven macroblocks is 

of f^., by i faM the resultant frame rate becomes smaller increased; and when the current coding amount is smaller 

than the target frame rate. However, the target coding lhan me tar S et codin S amount ScB, afyff , taking into account 

amount per frame becomes greater, thus making it possible ^ c current position of coding, the quantization stepsize for 

to mitigate block distortion and/or mosquito noise even the next eleven macroblocks is decreased. More explicitly, 

when scene change coding which needs a large amount of lhe quantization stepsize for the next eleven macroblocks 

coding is performed. 3S ® V n*„ & calculated by the following formula (17): 

Operation control section 61 also activates initial quanti- QP„ e>v =ScAvc QP^/KCB^CMB/mtO+B,. j-B^J/b^J (17), 

zation stepsize computing section 63, at the beginning of where MB ^ ^ numbef of macroblocks in one frame (3% 

each frame, m order to compute the quantization stepsize of Mocks for CJF 99 UodB for QaF) mb fa ^ Qumber Q ) ^ 

the initial macroblock of each frame^ Here, average quan- { coded macroblocks ^ ^ ' current frame and g is 

tization stepsize IntraAveQP^ at the time of intraframe 4Q the coding amount of the previous frame obtained from the 

coding of the previous frame is used to compute quantiza- information as to ^ codi amount 

tion stepsize QP_ by the following equation (13): M Qp ^ fe inpm tQ qu * antization stepsize variational 

QP^oiatraAvcQF; ,*o.5 (13). ran S e checking section 64, it is checked whether QP^^ is 

within the predetermined range, following the aforemen- 

For the use in quantization stepsize computing section 68, 4 5 tioned method. QP^ is then supplied to switching section 

average quantization stepsize ScAveQP,-^ is determined by 44 ( FIG * 5 ) and quantization stepsize adding section 65. 

the following equation (14): This procedure for every eleven macroblocks is per- 
formed for all the macroblocks in the current frame. When 

ScAveQP^OP,,^ (14). the last eleven macroblocks have been quantized, or when 

50 the coding is interrupted, the quantization stepsizes used in 

Quantization stepsize variational range checking section the current frame are ave raged to renew ScAve QP. v ScAve 

64 checks whether the quantization stepsize determined by Qp. } j s ^ output t0 specific area enhancement coding 

initial quantization stepsize computing section 63 or quan- contro i section 43 ( F ig. 5) for subsequent processes, 

tization stepsize computing section 68 falls within the range FIG. 8 is a block diagram showing the configuration of 

between the predetermined minimum QP,^ and the prede- 5S specific area enhancement coding control section 43. Spe- 

termined maximum Q? maxi based on the following relations c ifi c area enhancement coding control section 43 comprises 

(15) and (16). When the relation is satisfied, QP^, is an operation control section 71, an initial quantization 

replaced by QP^.„ or QP max . This procedure is capable of stepsize computing section 72, a quantization stepsize varia- 

maintaining the picture quality within a uniform range, tiona i range checking section 73, a quantization stepsize 

wh np hp op op /irt 60 addm S action 74 > a target specific-arca-enhancement cod- 

wnen w„ c „<w min , then Qr new -Qt> mi „ (is), ing amount computing sQ C ti on 75, a specific area allocation 

when Q?„ ew >Q? max , then QP^-QP™, (16). coding amount computing section 76, a coding limit moni- 
toring section 77, a coding interrupting section 78, a quan- 

The quantization stepsize checked by quantization step- tization stepsize computing section 79 and an average quan- 

size variational range checking section 64 is output to 65 tization stepsize computing section 80. 

switching section 44 (FIG. 5) to quantize eleven macrob- Specific area enhancement coding control section 43 thus 

locks. This quantization stepsize is also output to quantiza- configured operates as follows: 
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Operation control section 71, based on the input mode activates target specific-area-enhancement coding amount 

control information (of the specific area mode), controls the computing section 75, at the beginning of each frame. Here, 

determining operation of the quantization stepsize for the the target coding amount for specific area enhancement 

subsequent macroblocks. In this embodiment, from the same coding, B ro ^„ is computed by following equation (24): 

viewpoint as above of reducing the processing amount, one 5 

quantization stepsize is determined every eleven B.a^rR/f,.^, (24). 
macroblocks, but the present method can be applied to 

determination of quantization stepsize for an arbitrary num- Tar S 6t ^ 6Clfic an » «HocaUon coding amount computing 

ber of macroblocks. Specifically, quantization stepsize may sec il0a 76 > based on ^ s P eclfic area block raa P 111(1 the 

be determined at intervals of an arbitrary period, every to block skip map computes the target codtng amounts per 

macroblock or every 33 macroblocks, for example. macroblock for the face area and the background area. First, 

For controlling the first frame to be subjected to specific f rom l „ he s P e ^ c , area block map, the number of macrob- 

area enhancement coding control after the switching from locks FaceMB belonging to the face area is determined. The 

scene change coding control, operation control section 71 " umber °f macroblocks belonging l0 the background area is 

activates initial quantization stepsize computing section 72 is NonFaceMB. Then, the number of coded macroblocks 

in order to compute the quantization stepsize of the first belonging to the face area (CodedFaceMB), the number of 

macroblock in the frame. Here, the average quantization * k T l PP e ^ ™ ,c '°" 0< *? belonging 10 ' he face area 

stepsize ScAveQP, 1 calculated from the last frame of the (NotCodedFaceMB), the number of coded macroblocks 

previous frame in the scene change coding mode is used to belonging to the background area (CodedNonFaceMB), and 

determine quantization stepsizes FaceQP^ and Non- 20 *e number of skipped macroblocks belonging to the back- 

FaceQP_ for the face area and the background area, S™ 0 ? area (NotCodedNonFaceMB) are determined using 

respectively, using the following relations (18) and (19): me , block ^ ma P- From these values > FaceAssignFactor 

and NonFaceAssignFactor, which represent in what propor- 

FaceQP^^ScAveQf,! (18) tion the codes are allotted to the face and the background 

areas, are computed in the following manner: 



NonFaceQP„ eM ,=ScAveQ,. 1 (19). 



25 



when FaceAssignFactor<1.2, then FaceAssignFactor- 1.0, 



and 



Since the last frame in the scene change coding mode had 

only one quantization stepsize without distinction between when i.2^FaceAssignFactor<5.o, then 
the face area and the background area, the quantization 

Stepsizes FaceQP^ and NonFaceQP_ have the Same 30 FaceA S signFa C torKFaceA SS ignFactor-1.0)'0.S4-1.0 7 

value. 

Quantization stepsize variational range checking section 
73 checks whether the quantization stepsizes for the face when FaccA!ls igDFactor^5.o, then FaceAmgnFacto^.o. (25) 
area and background area, determined by initial quantization 
stepsize computing section 72 or quantization stepsize com- 35 where 
puting section 79, fall within the respective ranges: between 
the predetermined minimum FaceQP,^ and the predeter- 
mined maximum FaceQP m ^, based on the following rela- FaceAssignFactor=(MB-NotCodedFaceMB-NotCodedNon- 
tions (20) and (21); and between the predetermined mini- ^5^2*!?? NonFaaAssignFacior^CMB-NotCod- 
\ T r* Vxn -j it- i f ■ j . n edFaceMB-NotCodedNonFaceMBFaceMB'FaceAssignFactor)/ 
mum NonFaceQP^ and the predetermined maximum <o CodedNonFaceMB (26). 

NonFaceQP ma;c , based on the following relations (22) and 

(23). When the relation is satisfied, FaceQP wvv is replaced Further, the target coding amounts per macroblock for the 

by FaceQP mj „ or FaceQP mojc , or NonFaceQP n(fVV is replaced face area and the background area, designated by FaceBit 

by NonFaceQP m ^ or NonFaceQP mflX . This procedure is able and NonFaceBit, are determined as follows: 

to maintain the picture quality within a uniform range. 45 

FaceBit=R *FaceAssignFactor/{f (ar<< . ( * (MB-NotCodedFaceMB- 

When FaceQP rt(:K ,<FaceQP mA „ then FaceQP^-FaceQP^,, (20), NotCodedNonFaceMB)} (27) 

when FaceQP^ H ,>FaceQP max> then FaceQP^^FaccQP^ (21), NonFaceBit-R*NonFaceAssignFactoT/{f (fl , ref *(MB-NotCoded- 

FaceMB-NotCodedNonFaceMB)} (28). 

when NonFaccQP ncB ,<NonFaceQP„ /rt , then NonFaceQP^.-Non- 50 

FaccQP m6 , (22), After the completion of quantization of every eleven 

t. w, ^« vt ^ ft „ VT ^ nn „ macroblocks, operation control section 71 activates coding 

when NonFaceQP^>NonFaccOP„ ox , then NonFaceQP„ fM ,=Non- ■ ^ j- i* • . 

FaccQP„„ (23). umit monitoring section 77. Coding limit monitoring section 

max 11 receives the coding amount information representing the 

The quantization stepsizes thus checked are output to 55 present coding amount of the current frame from coding 

quantize eleven macroblocks. Based on the specific area section 5 (FIG. 2) and acquires the amount of coded infor- 

block map from specific area extracting-section 14 (FIG. 2), mation (coding amount B Vmb ) up to the current macroblock 

if the macroblocks to be quantized are in the face area, in the current frame so as to check, biased on the aforemen- 

FaceQP wvv is selected, and if the macroblocks to be quan- tioned relation (10), whether the input exceeds present 

tized are in the background area, NonFaceQP^ is selected. 60 coding limit B max . mb . When the relation (10) is satisfied, it 

This quantization stepsize is also supplied to quantization means that the current coding amount surpasses the coding 

stepsize adding section 74, where the used quantization limit. Therefore, the coding amount cannot be increased 

stepsizes are added up in order to determine the average above its present amount. At this moment, coding interrupt- 

quantization stepsizes for the face area and background area ing section 78 stops the quantization of the remaining 

in one frame. 65 macroblocks in the current frame while average quantization 

Further, in order to compute the target coding amount per stepsize computing section 80 computes the present average 

frame for the current frame, operation control section 71 quantization stepsize and outputs it. Since macroblocks 
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downstream will not be coded, the picture of the previous 
frame will be used. 

Quantization stepsize computing section 79 is activated 
when coding limit monitoring section 77 has determined that 
the current coding amount is not greater than the coding 5 
limit. This section operates based on the specific area block 
map and the block skip map so that when the current coding 
amount is greater than the target coding amount B target 
taking into account the current position of coding, the 
quantization stepsize for the next eleven macroblocks is 10 
increased; and when the current coding amount is smaller 
than the target coding amount B mrKef taking into account the 
current position of coding, the quantization stepsize is 
decreased. More explicitly, the quantization stepsize for the 
next eleven macroblocks NonFaceQP M<rw is calculated by the 15 
following formula (29): 

NonFaceQP„ cw -AveNonFaceQP rttfH ,*(1.0+NaDFaceOP /#c(ar ), Non- 
FaceQP /jIC(flr -2.0 * { B^ /) -(FaceBit*codedfacemb+ 
NonFaceBit*codednonfacemb)*(MB-NotCodcdFaceMB-Not- 
CodedNonFaceMB)}/{B / „ t<i *(codedfacemb+ 20 
coded no nfacemb)} (29), 

where MB is the number of macroblocks in one frame (396 
blocks for GIF, 99 blocks for QCIF), codedfacemb is the 
number of the present coded macroblocks belonging to the 25 
face area in the current frame, codednonfacemb is the 
number of the present coded macroblocks belonging to the 
background area in the current frame, and is the coding 
amount of the previous frame obtained from the information 
as to the coding amount. 3Q 

Depending upon NonFaceQP MffVV , quantization stepsize 
FaceQP^ for the macroblocks belonging to the face area 
contained in the next eleven macroblocks is renewed in 
following two conditions: 

NonFaceQF„,^NonFaceQP„,,.„ (30) 35 

NonFaceQP^^NonFaccQP,,^ (31). 

When relation (30) is satisfied, the current coding amount 
is lower than the target coding amount. Therefore, a smaller 
quantization stepsize can be used. Accordingly, FaceQP„ eH ,. 40 
is modified as follows: 

FaccQP^-FaccQP^-l (32). 

In contrast, when relation (31) is satisfied, the amount of the 45 
generated codes exceeds the target: coding amount. 
Therefore, it is necessary to reduce the coding amount. 
Accordingly, Face QP new is modified as follows: 

FaccQP„, M1 =FaccQP„^+l (33). 

50 

FaceQP ncvv , and NonFaceQP^.^, are input to quantization 
stepsize variational range checking section 73, and then it is 
checked whether the quantization stepsizes are within the 
predetermined ranges, following the aforementioned 
method. FaceQP wvv and NonFaceQP rttfH , are then supplied to 55 
switching section 44 (FIG. 5) and quantization stepsize 
adding section 74. 

This procedure for every eleven macroblocks is per- 
formed for all the macroblocks in the current frame. When 
the last eleven macroblocks have been quantized, or when 60 
the coding interrupted, the quantization stepsizes used in the 
current frame are averaged to renew quantization stepsizes 
FaceAveQP / _ 1 and NonFaceAveQP ( _ r These are then out- 
put to quantization stepsize computing section 80 to com- 
pute the quantization stepsizes for the next frame. 65 

In the above way, a greater amount of coding is allotted 
to the macroblocks representing the face area than those for 
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the background area, so that it is possible to improve the 
picture quality of the face area. 

As has been obvious from the above description, the 
apparatus of the invention has a coding control means, 
which, based on the mode determined by the coding mode 
determining means, sets up the quantization stepsize for the 
scene change frame and a predetermined number of frames 
downstream, for the quantizing means by reducing the frame 
rate without differentiating the specific area from the others, 
and sets up the quantization stepsize for the frames after the 
predetermined number of frames, for the quantizing means 
which restores the frame rate and increases the amount of 
coding for the specific area. Accordingly, when the picture 
quality is unstable immediately after a scene change, coding 
control is performed with importance put on the total picture 
quality while sacrificing the motion in the picture; and after 
the picture quality has been stabilized, coding control is 
performed so as to improve the picture quality of the specific 
area. Therefore, it is possible to suppress degradation of the 
picture quality producing less noise and distortion even at a 
fixed transmission rate. 

What is claimed is: 

1. Amoving picture coding apparatus comprising: 
a motion detecting means for detecting motion vectors by 
dividing the input picture into blocks of NxM pixels (N 
and M are natural numbers) and determining the inter- 
frame difference for each block between the current 
frame and the previous frame; 
a motion compensation predicting means for determining 
motion compensated prediction values from the motion 
vectors to select interframe prediction or interframe 
prediction; 

an orthogonal transforming means for obtaining trans- 
form coefficients by performing an orthogonal trans- 
form of the difference between the input picture and the 
motion compensated prediction values; 

a quantizing means for quantizing the transform coeffi- 
cients; 

a coding means for coding the quantized transform coef- 
ficients to generate coded information; 

a block skip determining means for determining blocks to 
skipped without coding, based on the interframe 
difference, determined by the motion detecting means, 
between the current frame and the previous frame and 
based on the determined result of the motion compen- 
sated prediction obtained from the motion compensa- 
tion predicting means; 

a specific area extracting means for extracting specific 
area from the input picture; 

a scene change detecting means for detecting a scene 
change based on the interframe difference; 

a coding mode determining means which, when the scene 
change detecting means has detected a scene change, 
determines which mode the current state is in among 
three modes, the scene change frame mode for coding 
the scene change frame, the post-scene change mode 
for coding a predetermined number of frames after the 
occurrence of the scene change, and the specific area 
mode in which frames downstream are coded to 
improve the quality of picture of the specific area which 
has been extracted by the specific area extracting 
means; and 

a coding control means which, based on the mode deter- 
mined by the coding mode determining means, controls 
the quantization in a manner such that a scene change 
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frame and a predetermined number of frames down- 
stream are quantized by setting up a quantization 
stepsize at the quantizing means and by using the 
quantization stepsize which allows no discrimination 
between the specific area and the area other than the 
specific area whilst thinning frames; and frames after 
the predetermined number of frames are quantized 
setting up a quantization stepsize at the quantizing 
means for increasing the coding amount of the specific 
area whilst restoring the original frame rate, wherein 
the coded information is transmitted at a predetermined 
frame rate by making the system capacity match the 
transmission rate of the network. 

2, The moving picture coding apparatus according to 
claim 1, wherein the coding control means comprises: 

an intraframe coding control means which, in the scene 
change frame mode, increases the amount of coding per 
frame by reducing the frame rate and sets up a quan- 
tization stepsize based on which the scene change 
frame is coded by intraframe coding without making 
any distinction as to the specific area; 

a scene change coding control means which, in the 
post-scene change mode, increases the amount of cod- 
ing per frame by reducing the frame rate and sets up a 
quantization stepsize based on which a predetermined 
number of frames after a scene change are coded using 
the information of the previous frame without making 
any distinction as to the specific area; 

a specific area enhancement coding control means, which 
in the specific area mode, sets up a quantization step- 
size in accordance with the coding amount information 
from the coding means, to perform coding based on the 
information as to skip blocks obtained from the block 
skip determining means and based on the information 
as to the specific area extracted by the specific area 
extracting means; and 

a switching means for selecting one of the three control 
signals based on the mode information from the coding 
mode determining means. 

3. The moving picture coding apparatus according to 
claim 2, wherein the intraframe coding control means com- 
prises: 

a target intraframe-coding amount computing means for 
calculating the target coding amount of a scene change 
frame with the frame rate reduced; 

a quantization stepsize setting means, which sets up a 
quantization stepsize based on the target coding 
amount, using the previously prepared relationship 
between target coding amounts and quantization step- 
sizes; 

a coding limit monitoring means which, based on the 
maximum coding amount per frame defined by the 
standard, monitors whether the amount of coding in the 
coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 

a quantization stepsize increment means for increasing the 
quantization stepsize when the amount of coding in the 
coding means exceeds the coding limit; 

a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize setting means and the quantization stepsize 
which has been increased by the quantization stepsize 
increment means; and 

an average quantization stepsize computing means for 
calculating the average value of the quantization step- 
sizes thus added, 



15 



20 



25 



30 



35 



50 



55 



65 



wherein all the above means are activated when the scene 
change frame mode information is input from the coding 
mode determining means. 

4. The moving picture coding apparatus according to 
claim 2, wherein the scene change coding control means 
comprises: 

a target scene-change-coding amount computing means 
for calculating the target amount of coding per frame by 
reducing the frame rate; 

a coding limit monitoring means which, based on the 
maximum coding amount per frame defineld by the 
standard, monitors whether the amount of coding in the 
coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 

a coding interrupting means for interrupting the coding of 
the current frame when the present amount of coding 
exceeds the coding limit; 

a quantization stepsize variational range checking means, 
which checks whether the input quantization stepsize 
falls within the specified range, and replaces the quan- 
tization stepsize with a closest value thereto falling 
within the specified range when the quantization step- 
size falls out of the specified range, while uses the 
original quantization stepsize when the quantization 
stepsize falls within the specified range; 

a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize variational range checking means; 

an average quantization stepsize computing means for 
calculating the average value of the quantization step- 
sizes thus added; 

an initial quantization stepsize computing means which 
computes the initial quantization stepsize based on the 
average quantization stepsize in the scene change frame 
and outputs the result to the quantization stepsize 
variational range checking means; and 

a quantization stepsize computing means which computes 
the quantization stepsize based on the target amount of 
coding, the information of the amount of coding not 
exceeding the coding limit and the average quantization 
stepsize for the previous frame and outputs the result to 
the quantization stepsize variational range checking 
means, 

wherein all the above means are activated when the post 
scene change mode information is input from the coding 
mode determining means. 

5. The moving picture coding apparatus according to 
claim 2, wherein the specific area enhancement coding 
control means comprises: 

a target specific-area-enhancement coding amount com- 
puting means for calculating the target amount of 
coding per frame; 

a target coding amount computing means for specific area 
allocation which, based on the information as to skip 
blocks from the block skip determining means, the 
information as to the specific area extracted by the 
specific area extracting means and the information as to 
the target amount of coding from the target specific- 
area-enhancement coding amount computing means, 
computes the amount of coding to be allotted for the 
specific area and that for other than the specific area; 

a coding limit monitoring means which, based on the 
maximum coding amount per frame defined by the 
standard, monitors whether the amount of coding in the 
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coding means exceeds the coding limit, every prede- 
termined number of blocks, where the coding limit is 
set up for every predetermined number of blocks; 

a coding interrupting means for interrupting the coding of 
the current frame when the present amount of coding 5 
exceeds the coding limit; 

a quantization stepsize variational range checking means, 
which checks whether the input quantization stepsize 
falls within the specified range, and replaces the quan- 
tization stepsize with a closest value thereto falling 10 
within the specified range when the quantization step- 
size falls out of the specified range, while uses the 
original quantization stepsize when the quantization 
stepsize falls within the specified range; 

a quantization stepsize adding means which adds the 
quantization stepsize determined by the quantization 
stepsize variational range checking means; 

an average quantization stepsize computing means for 
calculating the average value of the quantization step- 
sizes thus added; 
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an initial quantization stepsize computing means which 
computes the initial quantization stepsize based on the 
average quantization stepsize in the post -scene change 
mode and outputs the result to the quantization stepsize 
variational range checking means; and 
a quantization stepsize computing means which computes 
the quantization stepsize based on the target amount of 
coding, the information of the amount of coding not 
exceeding the coding limit, the information as to skip 
blocks from the block skip determining means, the 
specific area information from the specific area extract- 
ing means and the average quantization stepsize for the 
previous frame and outputs the result to the quantiza- 
tion stepsize variational range checking means, 
wherein all the above means are activated when the specific 
area mode information is input from the coding mode 
determining means. 
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